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I. INTRODUCTION 


[The Navy] requires officers capable of original thought and the capacity to synthe- 
size broad areas of knowledge, analyze complex issues, and appreciate the dis- 
tinction between what is theoretically possible and actually achievable. Investment 
in graduate education must be pursued as a priority, even in the face of fiscal aus- 
teritv and competing demands for our junior officers. 
Admiral Carlisle H. Trost 
[Ref. 1: p. 4] 
To carry out this Chief of Naval Operations Policy, the Navy must select those of- 
ficers for graduate education who will succeed in their academic endeavor and benefit the 
service. Most officers selected attend the Naval Postgraduate School in Monterey, 


California. There they study a variety of technical, scientific and management curricula. 


À. ADMISSION STANDARDS 

The Naval Postgraduate School, as all other graduate schools, seeks to enroll those 
students who have the best chance for success in their academic endeavor and their re- 
lated professional careers. It 1s impossible to accurately predict the future, but measures 
are available for assessing academic potential. Among these are the Graduate Record 
Examination (GRE), the Graduate Management Adnission Test (GMAT), undergrad- 
uate grade point averages, personal recommendations and resumes of extracurricular 
and community activities. 

The Chief of Naval Operations’ policy is that graduate education be afforded those 
officers “who have demonstrated superior professional performance and the intellectual 
capability to complete a rigorous academic program.” [Ref. 1: p. 4] The Navy, therefore, 
assesses a prospective student's academic potential through professional military per- 
formance, potential for further promotion and the Academic Profile Code. The Aca- 
demic Profile Code is actually a combination of assessments: undergraduate grade point 
average and undergraduate exposure to math and science. 

The Navy is interested in the best match between individuals and education pro- 
grams it can achieve. This is particularly true when it comes to graduate education for 
its officers. A great deal is invested in the Naval Postgraduate School and the officers 
who attend. Beyond the obvious costs of maintaining an institution on a par with 
prestigious civilian graduate schools, there are opportunity costs to the Navy in having 


officers attending school instead of performing their military missions in the fleet. 


The question is: Do the Navy's current admission criteria provide the best match 


between individual and curricular progran? 


B. BACKGROUND 

The 1984 Graduate Education Review Board met in October of that vear to plan 
resolution of issues discussed at the meeting of the Graduate Education Review Group 
two days earlier. One issue of interest was graduate education selection and admission 
criteria. 

The Vice Chief of Naval Operations, in January 1985, requested "NPS. OP-01 ex- 
plore the use of indices to measure the quality and potential of entering graduate stu- 
dents." [Ref. 2] He further suggested that "national norms such as the Graduate Record 
Examinations should be considered [as] these factors could ultimately provide useful 
broad-based correlations on subsequent student academic performance and provide 
useful quality control data.” [Ref. 2] 

In response to this tasking, the Superintendent of the Naval Postgraduate School 
identified three deficiencies of the Academic Profile Code: 

1. Differences in institution standards cannot be measured. 


2. There is an engineering bias. 


3. Written and verbal skills are not quantified. [Ref. 3] 


He further recommended the Graduate Record Examination be required of all offi- 
cers during college or during officer training. His recommendation discussed the benefits 
of the Graduate Record Exanunation: uniformity and data for correlation analvsis re- 
garding admussion criteria and success in graduate school. 

Another exchange of letters followed this initial round and culminated in June of 
1985 with approval of a three-year study of the Graduate Record Examination. Thus 
letter indicated that all officers ordered to the graduate program from April 1986 until 
April 1989 would be required to take the Graduate Record Examination before arrival 
at the school. The scores would be reported to Commander, Naval Military Personnel 
Command for inclusion in the officer master file. This would allow Naval Postgraduate 
School to collect data for analysis. [Ref. 4] 

A final correspondence exchange authorized administration of the Graduate Record 
Examination within the first two weeks of students” arrival at the Naval Postgraduate 
School. That is the form of the study which is currently underway. All U.S. Navy ofh- 


cers take the Graduate Record Examination within the first few weeks of arrival at the 


to 


school. Scores are subsequently reported to Commander, Naval Military. Personnel 


Command and to the Naval Postgraduate School. 


C. RESEARCH QUESTIONS 
The questions addressed in this thesis are: 


]. Which criteria predict academic performance at the Naval Postgraduate School 
better: Academic Profile Code scores or Graduate Record Examination scores? 


2. Is there a difference in the predictive value for different curricula? 


How do the Naval Postgraduate School students compare with other graduate 
students at other institutions? 


us 


II. LITERATURE REVIEW 


Not much research has been done at the Naval Postgraduate School regarding al- 
ternate admission or selection criteria. Most efforts were class projects, staff specu- 
lations or studies directed toward a specific curriculum. There was apparently an effort 
to institute the Graduate Record Examination as a selection variable in the 1960s. A 
series of three theses was written during that time discussing the Graduate Record Ex- 
amination as Well as other predictive instruments. All three, though focusing on the 
management curriculum, bear mention. Other studies conducted in the 1970s and 1980s 


are also of interest to this thesis. 


A. 1960'S 
l. Martz/Rushin 

In 1962, Martz and Rushin produced the first of this series of theses examining 
the use of the Graduate Record Examination in the management curriculum. They 
considered the Graduate Record Examunation, the California Analogies and Reasoning 
Test and the Navy Officer Classification Battery. After performing a number of statis- 
tical tests on data collected from the 1962 class (N = 94), they determined the Graduate 
Record Examination was the most statistically significant of the instruments exanuned. 
Their recommendation to use the Graduate Record Examination was couched in hesi- 
tant terms, however. Specifically, “the Graduate Record Examination (aptitude) 
produced by the Educational Testing Service was found to be the best of rhe thi -EE 
struments considered but 1s encumbered with certain restrictions that reduce the adapt- 
ability for Navy-wide testing as proposed in this study. The Graduate Record 
Examination is recommended as a highly effective tool for faculty-student counselling 
and guidance programs." [Ref. 5: p. i] 

2. Kauder/Ebert 

The second ın the Management School theses series was written ın 1963 by 
Kauder and Ebert. They studied the Navy Officer Classification Battery, the Graduate 
Record Examination and the Navy Officer Qualification Test. Statistical analysis was 
conducted on the class of 1963 (N=94) with a statistical reliability of 95 percent. 
Kauder and Ebert concluded that the Graduate Record Examination had a very high 


Validity and was, in fact, the best predictor of the three options. Based upon this 


conclusion, they recommended the Graduate Record Examination be used as the ad- 
mission criterion. [Ref. 6] 
3. Dreese/Russel 

Finallv, in 1964, Dreese and Russel examined the Graduate Record Examina- 
tion, the Structured-Objective Rorschach Test-Sort, the Allport-Vernon-Lindzey Studv 
of Values and a local questionnaire of motivation. They studied the management class 
of 1964 (N=99). After extensive statistical correlation, they concluded that the Gradu- 
ate Record Examination was an "excellent predictor of academic performance" [Ref. 7: 


p. 29] and should be administered to management candidates. [Ref. 7] 


B. 1970'S 
l. Cook 

Worthy of mention is a thesis conducted in 1974 by Cook. This paper is con- 
cerned with the merits of the Graduate Record Examination, the Strong Vocational In- 
terest Blank, a biographical questionnaire and undergraduate academic performance in 
determining success in the Communications Management curriculum (N42). This 
thesis, unlike the previous studies, considered not only psychological and testing instru- 
ments, but also the Educational Potential Code. The Educational Potential Code was 
an earlier version of today's Academic Profile Code. His conclusion did not specify 
which of these instruments was best, but instead built a series of tables with combina- 
uons of indicators to assist 1n student selection. [Ref. 8] 

2 Elster 

In August of 1974, Professor R. S. Elster prepared a letter to the Naval Per- 
sonnel Research and Development Center offering a manual to be used bv the graduate 
education selection boards. It contained prediction tables for four curricula. These ta- 
bles were based on such factors as undergraduate grades, undergraduate university 
"School scores," age, foreign language abilitv, whether or not the officer was a Naval 
Academy graduate, rank, Graduate Record Examination scores and whether or not the 
officer had an engineering degree. The tables were to be used after the selection boards 
had considered professional military performance and undergraduate academic 


performance. [Ref. 9] 


C. 1980S 
l. Michealson/Phillips/Jeong/Lee 
In a 1985 class project, Michealson, Phillips, Jeong and Lee attempted specif- 


ically to look at correlations between final grades and the Academic Profile Code, as well 


as final grades and undergraduate grade point averages. Thev studied the December 
1984 graduating class (N= 52). They found the highest correlations among those stu- 
dents who were Naval Academy graduates and those students who were in technical 
curricula. One would expect this result since the Academic Profile Code measures not 
onlv the undergraduate grade point average, but also exposure to technical curricula. 
[Ref. 10] 
2 Blatt 

Blatt used an analysis of variance technique to look at students in the Oper- 
ations Analysis curriculum (N=159). He was interested in student performance as 
measured by the Academic Profile Code, time since undergraduate studies, which 
undergraduate college the student attended, what kind of degree the student earned, 
what the student's military desginator was and whether or not the student had attended 
the math refresher training before starting the Operations Analysis courses. He found 
the undergraduate grade point average score of the Academic Profile Code to be a sig- 
nificant variable. The math and science codes of the Academic Profile Code, however, 
were not meaningful. Other factors he found to be significant were the time away from 
undergraduate studies, military designator and tvpe of college degree. [Ref. 11] 

3. Barri Howard 

Perhaps the most definitive and useful study done to date was accomplished bv 
Barr and Howard in 1987. They took a preliminary look at data collected from the 
three-vear study begun in April 1986. Their report encompassed 320 records of students 
who had taken the Graduate Record Examination and had completed at least three 
quarters of study at the Naval Postgraduate School. 

Their conclusions were five-fold: 


l. Using the Graduate Record Examination in conjunction with the other currently 
used admission criteria will significantly improve the prediction. 


tờ 


The best selection of variables is the verbal and quantitative scores of the Graduate 
Record Examination used with the undergraduate grade point average score of the 
Academic Profile Code and the student's age. 


The math and science scores of the Academic Profile Code are not significantly 
useful in prediction. Thev are, however, still an important part of the admission 
criteria. 


u 


4. Predictor sienificance varies over curricula. 


Distinguishing poor performers is difficult using the variables available. [Ref. 12] 


IM. ASSUMPTIONS AND METHODOLOGY 


The primary issue of this thesis is whether or not the Graduate Record Examination 
is a good predictor of success at the Naval Postgraduate School. What is success? How 
is it measured? This chapter will attempt to define success, the indices used to measure 
it and the methodology used to determine the applicability. and strengths of those 
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A. "SUCCESS" AT THE NAVAL POSTGRADUATE SCHOOL 
How does one define success as related to academic performance? Grades, student 
involvement in campus affairs, the degree, quality of the thesis; all could be considered 
indicators of success. Hartnett and Willingham discuss how criteria for success are 
widely defined among schools, school departments, and even curricula within depart- 
ments. Thev offer three categories of criteria. 
l. Categories 
The first category 1s “administrative measures” such as grades, exams, the thesis 
and status of the degree. Second, “professional accomplishments” such as recognition 
through awards or other honors, publications, professional activities and experience. 
And last, specially developed "objective criteria” of the sort than can be measured such 
as Work sainples, common examinations or ratings of competencies and characteristics. 
EER TS: p. 10] 
The remainder of their study discusses merits and weaknesses of each of the 
criteria mentioned. Of particular interest to this study is their discussion of grades as a 
measure of success. 
2. Grades 
a. Advantages 
On a positive note, Hartnett and Willingham suggest that grades are an in- 
dication of the faculty’s view of academic progress. They are readily available for all 
students in a scale easily interpreted by most. They also appear to be a composite in- 
dicator of variations in academic performance in a variety of courses. [Ref. 13: pp. 11-12] 
b. Disadvantages 
There are a number of disadvantages in using grades as a predictor. Grades 
generally are of a very restricted range and do not reflect the potentially wide range of 


differences in student accomplishment. Standards are extremely variable over time, 


institutions, departments and curricula. The basis of the grades is not always clear: 
exams, papers, research and class participation are all possibilities. [Ref. 13: pp. 12-13] 
Thev conclude “that while grades serve several useful functions in graduate 
education, the one served least well is that of providing an understandable criterion of 
graduate student performance.” [Ref. 13: p. 14] They acknowledge that grades are part 
of the evaluation process and should be used judiciously. 
3. Quality Point Rating as the Preferred Measure of Success 
Taking the above cautions under consideration, this studv will use grade average 
as the criterion against which to measure success in graduate school. The Naval Post- 
graduate School term for grade average is “Quality Point Rating.” 
The Quality Point Rating 1s a weighted average of grades computed using the 


grade values depicted in Table 1. 


Table 1. QUALITY POINT RATING COMPUTATION 


Points 
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Source: Admissions Office Handout 


The values in Table | are multiplied by the number of quarter-hour credits for 
each course. All course quality points are then summed and subsequently divided by the 
total number of credit hours. The resulting number is the Quality Point Rating. The 
Quality Point Rating is calculated separately for total performance in all courses and for 


graduate-level courses. [Ref. 13: pp. 20-21] 


The Naval Postgraduate School defines success in graduate education as being 
eligible for the Master's Degree by attaining "a minimum average Quality Point Rating 
of 3.00 in all the 3000 and 4000 level [graduate] courses in [the] curriculum. and 2.5 in 


Meremang courses ora 2-75. m all courses of the curriculum.” (Ref. 14: p. 21] 


B. ADMISSION CRITERIA 
l. Academic Profile Code 
The Academic Profile Code 1s currently used in conjunction with professional 
military performance as the most important admission criterion. It is composed of three 
digits reflecting the student's undergraduate experiences. 
a. Undergraduate Quality Point Rating Code 
This first digit of the Academic Profile Code describes the officer’s Under- 
graduate Quality Point Rating. Table 2 displays the code, grades and Undergraduate 


Quality Point Rating range. 


Table 2. UNDERGRADUATE QUALITY POINT RATING CODE 


Code Grade UQPR Range 
0 AJA 3.60-4.00 
B + 3.20-3.59 
B-B 2.60-3.19 


C+ 2.20-2.59 
C 1.90-2.19 
Below C 0.00-1.89 


Source: Admissions Office Handout 





Codes 0 through 3 must be based on a minimum of 100 semester or 150 
quarter hours of graded courses. Pass,fail, credit examinations and similar credits are 
not considered. 

b. Undergraduate Math Code 

The second digit of the Academic Profile Code indicates the officer's 
undergraduate exposure to math. A description of the codes follows in Table 3 on page 
10. 


Table 3. UNDERGRADUATE MATH CODE 


Calculus- Related Math Courses 


Significant post-calculus math with a B average 


Two or more calculus courses with a B+ average 

Two or more calculus courses with a C+ average 

One calculus course with a C grade or better 

Two or more pre-calculus courses with a B average or better 
At least one pre-calculus course with a C grade or better 
No college-level pre-calculus course with a C grade or better 





Source: Admissions Office Handout 


c. Undergraduate Technical Code 
The final digit of the Academic Profile Code reflects undergraduate experi- 


ence in physics or engineering. The codes are interpreted in Table 4. 


Table 4. UNDERGRADUATE TECHNICAL CODE 


Courses 
Significant upper-division course coverage in a pertinent 
engineering or physical science discipline with a B+ average 


Significant upper-division course coverage in a pertinent 
engineering or physical science discipline with a C+ average 


Complete calculus-based physics sequence with a B+ average 
Complete calculus-based physics sequence with a C+ average 
At least on calculus-based physics course with a C grade 


None 


Source: Admissions Office Handout 





2. Graduate Record Examination 

The Graduate Record Examination has been in use in one form or another since 
the late 1930s. This standardized paper and pencil test was first administered as a 
batterv of eight exams measuring math, physics, chemistry, biologv, social studies, liter- 
ature, fine arts and verbal skills. Advanced tests (known today as subject exams) were 
also developed to measure skill in very specific areas of study. [Ref. 15: p. 2] 

The exams have been revised constantly over the vears and the number of stu- 
dents taking the exam has increased as well. The format of the examinations adminis- 
tered during the Naval Postgraduate School study has been in use since 1981. It was 
during that year Educational Testing Service conducted a major revision of the General 
Test, particularly of the analytical measure. Until 1981, Educational Testing Service had 
cautioned against using the analytical measure for admission decisions. These cautions 
Rene since been removed, [Ref, 16: p. 7] 

a. The Exam 
The General Test, which 15 being administered during the Naval Postgrad- 
uate School study, consists of three measures of “developed ability.” [Ref. 16: p. 6] 
Questions using antonyms, analogies, sentence completions and reading comprehension 
make up the verbal measure. Quantitative skills are examined through use of discrete 
quantitative questions, data interpretation and quantitative comparisons. Finally, the 
analytical section of the exam tests analytical reasoning and logical reasoning. [Ref. 
16: p. 7] 
b. Scores 
Scores on these three measures are the total number of questions an 
examinee answered correctly in each section (the raw score) equated with previous edi- 
tions of the exams. This process allows the scaled scores reported to Naval Postgraduate 
School to be compared over time with scaled scores of other students taking older ex- 
ams. The only exception to this 1s that analytical scores after 1981 are not comparable 
texthose before the 1981 revision. [Ref. 16: p. 31] 
c. Percentiles 
Ihe percenule ranks reported along with the scaled scores are not interpre- 
table over time. These rankings are made for a specific group of test takers. Educational 
lesung Service provides a table of percentile ranks which can be used to interpret 


rankings of test scores earned before 1986-87. [Ref. 16: p. 31] 
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d. Guidelines 
Educational Testing Service provides guidelines to administrators for the 
use of the Graduate Record Examination scores. Thev suggest that the Graduate Re- 
cord Examination has two limitations: 1) it cannot measure a// qualities which make 
up an individual and contribute to academic success and 2) “only score differences of 
certain magnitudes are reliable indicators of real differences in performance.” [Ref. 16: 
p. 14] Throughout the Guide Educational Testing Service cautions against using the 
Graduate Record Examination Scores as the onl} criterion for admission or selection. 
There are many factors besides test scores which should be considered. They also cau- 
tion against using a minimum (cut-off) score philosophy for the same reason. [Ref. 16] 
e. The Graduate Record Examination as an Admissions Standard 
A number of papers have been written discussing the Graduate Record 
Examination used as an admissions standard. Oltman and Hartnett indicated that about 
64 percent of the graduate programs either require or recommend Graduate Record 
Examination scores. They also surveyed administrators to find out how the Graduate 
Record Examination scores were used. Most respondents who use the exam scores in 
their admission process do so to supplement other, perhaps less satisfactorv academic 
credentials. Undergraduate grades were consistently rated as the most important ad- 
missions factor. Ref. 17] 
f. The Graduate Record Examination as a Grade Predictor 
There has also been some concern about the validitv of the Graduate Re- 
cord Examination as a predictor of graduate grades. Wilson provides a good discussion 
of the subject based on the results of "The GRE Cooperative Validity Studies Project" 
conducted bv Educational Testing Service in the latter half of the 1970s. The biggest 
concerns in past studies were: 1) most of the samples were quite small, making results 
unreliable and 2) various institutions had different ideas about what “success” in gradu- 
ate school actually was. Wilson reports, however, that throughout the Validity Studies, 
grade point average was the common factor and was usuallv positive. He also stated 
that the Graduate Record Examination was generally a better predictor of graduate 


grades than other factors studied. [Ref. 18] 


C. METHODOLOGY 
Statistical procedures in this thesis will focus primarily on exploring correlations 


between the Graduate Record Examination and Academic Profile Code indices and the 


Graduate Quality Point Rating. The goal is to determine which measures are most 
stronglv and significantly correlated with Graduate Quality Point Ratings. 

Additionallv, the various indices will be regressed against Graduate Quality. Point 
Rating. The resulting equation can be used by graduate education selection boards as 
a predictor of academic success. 

The statistical package which will be used for this analvsis is SPSS* . SPSS* is a 
trademark of SPSS, Incorporated. 
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IV. DATA 


Ihe data analvzed were available in the Naval Postgraduate School Admissions and 
Registrar offices. A data set was entered manuallv from Graduate Record Examination 
score cards received at the Naval Postgraduate School from Educational Testing Service. 
Data included on these cards were social securitv number, date of birth, date of exam 
and the three Graduate Record Exanunation scores with their respective percentiles. 
This file was merged with four separate registrar files containing Academic Profile Code, 
curriculum, designator, rank, undergraduate information and grades earned at the Naval 
Postgraduate School. To protect the privacy of individual students, names were not in- 
cluded in any of the data. 

These data included only U.S. Navy students. The study has excluded other 
service students as well as international students. 

lo make the data more useful, several computations were performed. Age at time 
of examination was computed by subtracting date of birth from the date of the exam. 
lime awav from undergraduate studies was computed by subtracting date of under- 
graduate degree from date of exam. 

Since grading varies somewhat from department to department, cumulative Gradu- 
ate Quality Point Ratings were standardized to make them a better comparison measure. 
Standardizing allows for variations in department grading practices. The standardized 
scores Were computed by dividing students’ Graduate Quality Point Rating by a de- 
partment factor. The individual department factors were derived by dividing the de- 
partment averages bv the overall school average Quality Point Raung of 3.35 (which has 
remained relatively stable over several academic years) (Ref. 19]. Although the averages 
used were derived from all courses, not just 3000- and 4000-level courses, the numerical 
paucitv of lower-division courses presents little effect on the factors computed. The re- 
sulting department factors are presented in Table 5 on page 15. 

The merged file contained 786 cases. Six of the original Graduate Record Exam- 
ination cases could not be matched with registrar files and were removed. The remaining 
780 cases provide some interesting descriptive information about the U.S. Navy student 


population over the first 18 months of the study. 
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DEPARTMENT STANDARDIZING FACTORS 


Department 


Computer Science 

Mathematics 

Administrative Sciences 

Operations Research 

National Security Affairs (relatively easy grading) 
Physics (relatively tough grading) 

Electrical & Computer Engineering 

Meteorology 

Aeronautics 

Oceanographv 

Mechanical Engineering 

Antisubmarine Warfare Academic Group 
Electronic Warfare Academic Group 

Space Svstems Academic Group 

Command, Control & Communications Academic Group 


NPS--All Departments 


Factor 


1029 
1.009 

.980 

994 
Ce? 

ơi 

.986 
1.000 
WOT? 
1.006 
1.006 
1.000 
1.044 
1.044 
E905? 


1.000 





Since the studv began in April 1986, there have been seven administrations of the 
Graduate Record Examination for which data were available. These are shown, along 


with number of participating students in Table 6. 


Table 6. EXAM ADMINISTRATIONS 


Date of Exam Number of Examinees 
April 1986 66 
August 1986 148 
October 1986 155 


February 1987 
April 1987 
July 1987 
October 1987 
Total 
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Students in this study are overwhelmingly male: 84.4 percent. Most students are 
either lieutenants or lieutenant commanders, 72.6 percent and 24.6 percent, respectively. 
They are 31 vears old on average and have been away from undergraduate schooling an 
average of 7.6 vears. 

By military specialty, 66.7 percent are line officers (the majority being surface offi- 
cers (29 percent) and the minorities being special warfare, special operations and pilots 
(4.5 percent collectively)). Twenty percent are restricted line and the remaining 12.9 
percent are staff corps (mostly supply). 

The most popular curricula (the top 60 percent, listed in decreasing order) are com- 
puter systems, naval engineering, financial management, operations analysis, weapons 
systems engineering, electronic svstems, air-ocean sciences, computer science, space 
systems operations and antisubmarine warfare. 

Descriptive statistics (Shown in Table 7) regarding the Graduate Record Examina- 
tion, Academic Profile Code and Standardized Quality Point Rating (ZQPR) scores re- 


veal the following information: 


Table 7. DESCRIPTIVE STATISTICS 


Maximum 
Standard Possible 
Variable Minimum Maximum Deviation Range 


CORR Code 
Math Code 
Technical Code 
GRE-Verbal 
GRE-Quantitative 
GRE-Analvtical 
ZOER 


to “© 
ty CA 


U - 88 0-5 

U 6 0-6 

0 0-5 
S00 200-800 
800 200-800 
S00 219 200-800 

4.2] 0-4.27 
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Although the preceding information is very interesting and useful, there is concern 
about using this data for rigorous analysis. Most students have very few, if any, 
graduate-level courses in their first quarter or two. In most curricula the courses build 


in difficultv as the program progresses. Additionally, as a student progresses through 
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the curriculum, its many courses and varied professors, the Quality Point Rating be- 
comes a more accurate measure of overall academic ability. It is therefore unfair to 
compare the Graduate Quality Point Rating of a first-quarter student with that of a 
sixth-quarter student. By selecting those students who have completed exactly six 
quarters, one captures those who have graduated from 18-month curricula as well as 
those who have completed the majority of long curricula. These cases should provide a 
better measure of academic achievement. 

There 1s some concern among academics that there has been a steadv grade creep 
over the years. In other words, a 25-vear-old graduate student may have a higher 
undergraduate grade point average than a 40-year-old graduate student, yet be academ- 
ically equivalent. To attempt some limited correction for this, one case in which age at 
time of examination was 40 or greater was eliminated. 

By selecting only those records in which students had completed 6 quarters and were 
less than 40 vears old, the data set was reduced to 198 cases. These 198 cases are de- 
seribed in the following tables. 

Table S shows the breakdown by sex. Again, the vast majority of the students are 


men. 


Table 8. SEX--SIXTH-QUARTER DATA 


Sex Percent 


Male $0.8 
Female 19.2 





Military Specialties have been grouped into the three major categories of line, re- 
stricted line and staff corps as shown in Table 9 on page 18. 

Only three rank categories are represented in this data: lieutenant junior grade (one 
percent), lieutenant (71.2 percent) and lieutenant commander (27.8 percent). 

By limiting the data to those who have completed six quarters, the number of test 


administrations with usable data is limited to the five shown in Table 10 on page 18. 


Table 9. MILITARY SPECIALTY--SIXTH-QUARTER DATA 


Specialtv Percent Total Percent 


General Unrestricted Line 14.6 

Surface 2] 

Subsurface 6.1 

Special Warfare, Special Operations E3 

Aviation 14.1 
Total Line 


Total Restricted Ling 
Supply Corps 
Other Staff Corps 

Total Staff Corps 


Total 


Total column does not add to 100% due to missing cases. 





Table 10. EXAM ADMINISTRATIONS--SIXTH-QUARTER DATA 


Date ot barn Number of Examinees 


April 1986 11 
August 1986 60 


October 1986 111 
February 1997 13 
Apal 1987 3 
]otal 198 





Table 11 on page 19 lists the curricula, showing the percentage of those 198 stu- 
dents enrolled in each. 
Descriptive statistics were computed for this sample. Table 12 on page 20 includes 


the mean, minimum, maximum and standard deviation for the continuous variables. 


Table 11. CURRICULUM ENROLLMENT--SIXTH-QUARTER DATA 


Curriculum Percent 


Computer Systems ] 
Financial Management 

Material Logistics Support Management 
Naval Engineering 

Telecommunications Svstems Management 
Electronic Warfare 

Operations Analvsis 

Space Svstems Operations 

Antisubmarine Warfare 

Manpower, Personnel & Training Analysis 
NSA-Nuclear Strategic Planning 

Weapons Systems Engineering 
Acquisition & Contract Management 
Intelligence 

Computer science 

Air-Ocean Sciences 

Communication Engineering 

Operational Logistics 

Transportation Logistics Management 
Aeronautical Engineering 
NSA-International Organizations & Negouations 
Space Systems Engineering 
Transportation Management 

Underwater Acoustics 

Aeronautical Engineering 

Electronic Warfare 

Weapons Systems Science 

Command. Control & Communications 
NSA-Far East, Southeast Asia, Pacific 
NSA-Europe. USSR 

Svstems Inventorv Management 
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Table 12. DESCRIPTIVE STATISTICS--SIXTH-QUARTER DATA 


Standard 
Variable Mean Minimum Maximum Deviation 


Age 31.05 2 > 3.47 
lime Since Undergrad Degree — 7.65 17 2,98 
COPR Code 1.89 4 Oa 
Math Code 2.4] 6 1228 
Technical Code DD 1.66 
GRE-Verbal 545.46 93,02 
GRE-Quantitative 627.32 0 
GRE-Analvtical 588.38 99.60 
Standardized Graduate QPR 3.48 E .294 





V. ANALYSIS 


To develop an understanding of the relationship between the standardized Graduate 
Quality Point Rating and the various explanatory variables, it was useful to first look 
at simple correlations. The larger the correlation coefficient, the stronger the relation- 
ship. To further provide a better selection tool, regressions were run to estimate pre- 
dictive equations. 


To simplify discussion of the results, variables have been assigned the following 


names: 

Academic Profile Code 
Undergraduate Quality Point Rating Code APCI 
Math Code ADC 7 
Technical Code APC3 

Graduate Record Examination 
Verbal VB 
Quantitative QT 
Analytical AN 

Other Variables 
Age at time of exam (in vears) AGE 
Time since undergraduate degree (in vears) T 
Standardized Graduate Quality Point Rating ZQPR 
Predicted Graduate Quality Point Rating QPR* 


A. CORRELATION 

Using the SPSSx Pearson correlation function, correlation tables were constructed 
for the entire sixth-quarter data set as well as separately for the Policy and Information 
Sciences Division and the Sciences and Engineering Division. 

l. Sixth-Quarter Data 

Table 13 on page 22 depicts the relationship between ZQPR and three Gradu- 
ate Record Examination measures, the three Academic Profile Code measures, AGE and 
T. 

What becomes apparent in analyzing this table 1s that AGE and T are strongly 
correlated with one another and that T has a very small effect on ZQPR. Not only is 
the correlation a small absolute value, but it is significant only to the ten percent level. 
The other anomalies in this table are APC2 and APC3. Both are quite small and sig- 


nificant only to the ten percent level for APC2 and the five percent level for APC3. The 


Table 13. 


A 
AGE 1.000719 
(198) d 

00 


1.000 
(189) 


AN 

APCI 
ARC? 
ALCS 


ZOPR 


VB 
023 
(198) 


a 


150 
(189) 
.020 


1.000 
(198) 


Correlation Coefficient 
(Number of Cases) 
One- Tailed Significance Level, p-value 


AN 


-.269 
(198) 
.000 


RS, 
(189) 
.009 


446 
(198) 
000 


APC) 
O42 


CORRELATION TABLE--SINTH-QUARTER DATA 


AL GZ 
216 


(194) 


1.000 
(194) 


APC3 


m 
.001 


.214 
(185) 
.002 


-.042 
(194) 
EET; 


E 
(193) 
.000 


-.269 
(194 
(000° 


in 
] € 
107 


.562 
(194) 
.000 


1.000 
(194) 





remaining variables: AGE, VB, QT, AN and APC1 show reasonably strong correlations 
which are significant at the one percent level. 

The probable explanation is that the Graduate Record Examination quantita- 
tive and analytical sections are better measures of the math and science knowledge of 
an individual than the Academic Profile Code measures. 

The negative sign of the age factor suggests that “older” students do have 


slightly lower scores than their vounger counterparts. 


These correlation results hint that T, APC2 and APC3 do not contribute much 
to prediction of graduate success. 

The reader must remember Table 2 on page 9, Table 3 on page 10 and 
Table 4 on page 10 when interpreting correlation coefficients of the Academic Profile 
Code measures. The /ower the number in the code, the better. One would, therefore, 
expect negative correlations with ZQPR. The Graduate Record Examination scores, on 
the other hand, are “normal”--the higher the score, the better. These correlations are 
expected to be positive. 

2. Division Data 

Additionallv, tables were constructed for the two major Divisions within the 
school. The correlation results are displayed in Table 14 on page 24 and Table 15 on 
page 25. 

a. Policy and Information Sciences Division (05) 

For the Policy and Information Sciences Division (N= 135) the table shows 
similar results. T 1s now a small and insignificant factor. QT and APCI appear to have 
the strongest correlation with ZQPR. APC2 and APC3 are small and not as statistically 
significant as the GRE measures. 

b. Sciences and Engineering Division (06) 

In the Sciences and Engineering Division (N= 63) T, APC2 and APC3 are 
relatively small and insignificant. AGE appears to be a much bigger factor for this 
group. Perhaps that can be explained by the theory that quantitative skills decline as 
one gets older and does not use them as much. Of interest, though, is the verv strong 
correlation between ZQPR and QT: .5940 which is statistically significant at the one 
percent level. As might be expected for the scientists and engineers, VB is not nearly as 
strong as QT and AN. 

c. Conclusion 

Table 16 on page 26 combines the previous three correlation tables into 
one. Shown are the correlations between ZQPR and the eight explanatory variables 
discussed. 

These results confirm that the Graduate Record Examination measures 
along with APCI and AGE are the most useful in predicting success at Naval Post- 


graduate School. 
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Table 14. CORRELATION TABLE--DIVISION 05 


AGE ~ al Í AN ARCI 


AGE 153) (199) 01] Y 2? SET 
Do : 2 
.000 .91 E 1000 


1.000 ‚210 
[e : | (125) 
‚133 .42 03 .009 


APCI 
APC2 
APC) 
ZOPR 
Correlation Coefficient 


(> Uiaben or Gases) 
One- Tailed Significance Level, p-value 





B. REGRESSION 

SPSSx was used to perform regression analysis on the entire sixth-quarter data set 
as well as the two major divisions. The intent was twofold. One objective was to de- 
termine how much of the variance of a predicted Graduate Quality Point Rating could 
be explained bv the variables of interest. The second objective was to build an equation 


which could be used bv selection boards to predict academic success at the Naval Post- 


graduate School. 
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Table 15. CORRELATION TABLE--DIVISION 06 


AGE, T 


AGE 1.000 .732 
(63) 


D 1.000 
QT 

AN 

APCI 

APC2 

APC3 


ZQPR 


Correlation Coefficient 
(Number of Cases) 
One-Tailed Significance Level, p-value 





l. Sixth-Quarter Data 
Using the "enter" method, a regression of the Academic Profile Code was run 
against ZOPR. The intent was to see how well the Academic Profile Code predicted 
QPR*. Second, a regression equation was formed with just the three Graduate Record 
Examination scores. In order to see whether combining the two sets of measures would 
be a better prediction tool, a third equation was developed with all the Academic Profile 


Code and Graduate Record Examination measures as explanatory variables and ZQPR 
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Table 16. COMBINED CORRELATION TABLE 


Coefficients = correlations between ZQPR & the eight variables shown in this table. 
*One-tailed significance level = .000 


GRE APC Other 
VB QT AN ft 2 3 | AGE i 


Sixth-OT Ra .424* 0007 -348*  -.108 -121 -.244* -.096 
Div 05 .A38* on -431*  -.160 -.170 1... -.049 
Div 06 ge .384 -.203 -.160 -167 -.348 -.170 





as the dependent variable. Finallv, based on the earlier deductions, an equation was 
formed using VB, OT, AN, APCI and AGE to explain ZOPR and; hence DENS 

The hypothesis for this approach was that R? and R? would both increase with 
successive equations. while the confidence interval around the estimate would decrease. 
It is understood that R? will always increase with the addition of new variables. R? , 
which is R? adjusted for degrees of freedom, will increase only if the new variable con- 
tributes to the equation. 


The results of these equations are summarized in Table 17. 


Table 17. REGRESSION RESULTS--SIXTH-QUARTER DATA 


Variables 
Academic Profile Code 
A 2 ATA) 
E Record Examination 


4 
a 4 - 


APC and GRE Combined 
AJPGI APCO APCSUVB DITA 


Selected Variables 
APCET VB OT AD TAGE 





The Academic Profile Code alone explains only 13 percent of the variance in 
QPR*. The Graduate Record Examination alone predicts 22 percent. When combined, 


R? rises (as expected) to 27.6 percent. Interesting 1s that R? increases as well. Finally, 
p p x— e 
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the variables chosen as the best predictors increase AR? to 28.9 percent and increase /? 
W percent 


Forecast intervals were developed using Equation (5.1) below. 
FI 7 Yr tSt, (5.1) 


the forecast interval 


Where FI 


pu thetorecast 
S,  - the estimated standard error of the forecast 


the critical t value (in this case, 95 percent confidence) [Ref. 20] 


Pan 
Il 


For illustration, p = 3.479 (the mean ZQPR) for all equations, 1, = 1.96 and 
can be found in Table 17 on page 26 as SE. 

Computations reveal an ever-narrowing interval around the mean. See 
Figure 1 on page 28. These narrowing intervals combined with the good results of the 
regressions confirm the final set of variables in Table 17 on page 26 as the best predic- 
tors of success at Naval Postgraduate School. 

The prediction tool for selection boards to use would be the regression equation 
using VB, QT, AN, APCI and AGE shown in the order thev entered the regression 


equation: 


QPR* 2 3.2185 — .0137 AG E(in years) 4- .0006V B 


5.2 
— 08154 PCI + .0007Q T 4- .00014.N o2 


Ihe results will vield QPR*--a forecast of the officers Graduate QPR at the Naval 
Postgraduate School. OPR* will still be a standardized value. If a potential student's 
curriculum is known, QPR* can be multiplied by the appropriate department factor 
(Table 5 on page 15) to obtain a sharper estimate for that department. See Appendix 
A for which curricula belong in the departments. 
2. Illustration of Prediction Equation for Admission to NPS 

To illustrate the process, assume Lieutenant Junior Grade Grad is being con- 
sidered for graduate education. He is 27 years old. He graduated from American Uni- 
versity with a 3.00 grade point average. His Graduate Record Examination scores are 
550 verbal, 600 quantitative and 580 analytical. He is interested in studying in the 681, 


peor 532 curricula. 


27 


APC onlv 
GRE onlv 


APC and GRE 


ZU ID 
QT, AN, AGE 





Figure 1. Forecast Intervals--Sixth- Quarter Data 


Using Equation (5.2), the selection board would discover a potential Graduate 
QPR at the Naval Postgraduate School of 3.494. See Equation (5.3). 


QPR* 2 3.2185 — .0137(27) + .0006(550) 


5.3 
— .0815(2) + .0007(600) + .0001(580) = 3.494 2 


This predicted Graduate QPR can then be adjusted for the specific curricula Lieutenant 


Junior Grade Grad is interested 1n: 


for curriculum 681: adjusted QPR* = 3.494(1.067) = 3.73 
3.494(.980) = 3.42 


3.494(.951) = 3.32 


for curriculum 847: adjusted QPR* 


for curriculum 531: adjusted QPR* 


The board could further analyze this officer’s potential at the Naval Postgrad- 
uate School by putting a forecast interval around each estimate. This would allow the 
board 95 percent confidence that the officer's Graduate QPR would fall within the range 


indicated. 


3.73 + 1.96(.252); that is, 3.24  — 4.22 
3.42 + 1.96(.252); that is, 2.93 — > 3.91 
3.32 + 1.96(.252); that is, 2.83 — — 3.81 


Por curmculum os. El 


For curriculum 847: FI 


For curriculum 331: FI 


Lieutenant Junior Grade Grad mav not be as good a risk in the phvsics curric- 
ulum as in national security affairs, or even in manpower, personnel and training 


analvsis. 


3. Division Data 
Using the same procedures used for the entire data set, regressions were com- 
puted for Divisions 05 and 06. The premise is that the two Divisions may have sub- 
stantially different types of students. 
a. Policy and Information Sciences Division (05) 
Table 18 shows regression results for Division 05. The results are quite 
similar, bearing out the choice of APCI, VB, QT, AN and AGE as predictors. 


Table 18. REGRESSION RESULTS--DIVISION 05 


Variables 


APCI, APC2, APC3 

IB OT, AN 

APCI, APC2, APC3, VB, QT, AN 
"1" WIRE RS AGE 





Slightlv narrower forecast intervals are evident in Figure 2. These intervals 


are also built around the mean ZQPR of 3.48. 


APC only 
TREO 


APRC and GRE 


APCI. VB 
OTA ACE 





Figure 2. Forecast Intervals--Division 05 


Equation (5.4) 1s the prediction tool for this submodel. Tt could be used if 
the selection board were assured an officer would be interested in onlv Policy and In- 


formation Sciences curricula. 


OPR* = 3.1520 — .0052AGE(in years) -- .0004V B 
— .08144PC1 + .00070T + .00024N 


b. Sciences and Engineering Division ( 06) 
lable 19 on page 30 contains regression results for Division 06. The results 
for this subgroup are considerably stronger: R? = .4440 as compared to .3123 for Divi- 


sion 05. 


Table 19. REGRESSION RESULTS--DIVISION 06 


Y 


Variables 


APCI, APC2, APC3 

VB, QT, AN 

APCI, APC2, APC3, VB, QT, AN 
APC YVE OITAN ACE 





Forecast intervals for Division 06 are considerably wider than either the 
overall data or Division 05 data. See Figure 3. The wider intervals are due to lanes 
standard errors in this subgroup. One possible explanation is the smaller number of 
cases in this sample combined with the different tvpe of students. These intervals, again 


are built around the mean ZQPR of 3.48. 


APC only 
GRE onlv 


APC and GRE 


APCI, VB. 
QT, AN, AGE 





Figure 3. Forecast Intervals--Division 06 


Equation (5.5) is the prediction tool for this submodel. It could be used if 
the selection board were assured an officer would be interested in only Sciences and 


Engineering curricula. 


QPR* = 2.7122 — .0308AGE(in years) — .0693A PC] 
+ .0004VB — .0004AN + .00280T 
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c. Conclusion 

The Division regressions confirm the choice of variables for predicting 
Graduate QPR, namely, VB. QT, AN, APCI and AGE. A? in the Division computations 
is stronger in both cases than the overall regression. The results are strongest for Divi- 
sion 06. 

Using the individual Division prediction equations would be limiting to a 
selection board since the board would have to know exactly which curriculum an officer 
would be assigned to. A better tool would be Equation (5.2) which would allow a se- 
lection board to predict Graduate QPR for anv officer. The department factor could 


always be applied for individual curricula--perhaps during the assignment process. 


QPR* 2 3.2185 — .0137AGE(in years) + .0006VB 
—= .0SISAPCI + .00070T + .00014N 


Where QPR*= the predicted Graduate QPR 
AGE = the officer’s age 


VB = the Graduate Record Examination Verbal measure 
APCI2 the Undergraduate QPR 

QT = the Graduate Record Examination Quantitative measure 
AN = the Graduate Record Examination Analvtical measure 


C. DEPARTMENTS 

One of the original research questions was “Is there a difference in predictive value 
for different curricula?” In narrowing the specification of the data set, N became very 
small for individual curricula: range = 0 to 23. These small sample sizes would render 
computed statistics unreliable. 

Correlation and regression computations were made for the two departments in 


which N was greater than or equal to 25. Results are outlined in Appendix B. 


D. HOW DOES NAVAL POSTGRADUATE SCHOOL COMPARE? 

Educational Testing Service provides a means whereby an institution’s students’ 
scores on the Graduate Record Examination may be compared (in percentile fashion) 
to earlier test-takers. Table 20 on page 33 displavs percentile ranks and scaled scores 
for General Test examinees between 1981 and 1985. Added in the right four sets of 
columns are mean scores for all Naval Postgraduate School students who have partic- 


ipated in the study so far, sixth-quarter students and the 05 and 06 Division students. 
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m 


This table shows Naval Postgraduate School students well above | 


ing Service mean--particularly in the quantitative measure. 


2 


Table 20. GENERAL TEST INTERPRETIVE DATA 


Based on performance of General Test examinees between 1 Oct $1 & 30 Sep 84 


Percent of Examinees Scoring Lower Than Selected Scaled Scores 





Lr | AILNPS 6th-Qtr | Divos Div 06 
cale 
Scores VB QT AN | VB QT AN) VB QT AN YB QT AN | VB QT AN 
$00 99 99 | | 
780 99 98 98 
760 99 95 97 | 
740 98 92 96 | | 
720 96 $89 94 | 
E0095 099555 92 | 
680 93 81 N | % 
260) GINE T. 86 | 
640 S8 73 83 | m | 
l 
627 | 
620 85 67 79 | nus: 
600 81 64 76) | | 
| | | 593 
588 | | 
| 585 | 585 | 
580 78 58 70 | | | 
560 73 53 65, = | 
| > 
548 | | 
540 68 48 60; | | | 
NM | | | | 528 
2008630 da 54. | | | 
500 57 38 48. | | | 
SO 52 32 37) | | | 
omas 25 371 | | | 
440 40 24 3530 | | 
E50) 35.2 20 26 | 
400 29 17 24 | 
380 25 13 17 | 
Ta Oo il 1 | | | 
pA IG 8 9 
DM. 7 
300 10 5 4 
EOM m 3 3| 
BU 21 2 
STR C ETT 
B 1 ] | 
| 
Mean 472 539 505 | 
N = 785,276 | N = 780 N=18 | N= 135 N = 63 


Source: Educational Testing Service Guide [Ref. 16: p. 17] & research data set means 
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VI. LIMITATIONS 


The results shown from this study may be influenced to an undetermined degree by 
a number of factors. 

Most of the students taking the test during this three-vear study have been away 
from school for a number of vears. Does that affect their Graduate Record Examination 
scores? The exam is administered after arrival at the school. Does that affect students’ 
motivation, and subsequently, their performance? If motivation is high, would they 


study before taking the test? Would studving improve the scores? 


A. ADMINISTRATION OF THE GRADUATE RECORD EXAMINATION 

One of the concerns of the conduct of this study is the timing of the administration 
of the Graduate Record Examination. Most examinees take the test in their senior year 
of college or shortlv thereafter. Their purpose in taking the exam is to submit scores to 
graduate school as part of the admissions procedure. Their motivation is fairly well- 
defined: "The better I do on this test, the better my chances of getting into the school 
of my choice: 

During this study, the Graduate Record Examination is administered to incoming 
classes of students in their first few weeks of school. This is a time when students are 
in the process of readjusting to academic life and can be very close to the time of the first 
nudterm exams. Other than a personal pride and motivation to always do the best you 
can, there is no true incentive for doing well on the Graduate Record Examination 
These test-takers have been accepted and are enrolled; the exam results have no bearing 
on their academic or professional future. 

There are two conflicting views on this potential problem. In his response to the 
Graduate Education Review Board tasking, the Superintendent of the Naval Postgrad- 
uate School indicated that the “GRE was given to students at the Postgraduate School 
about twenty years ago, but only after they arrived and consequently served no use in 
the selection process.” [Ref. 16] Barr and Howard acknowledged that the data being an- 
alvzed are of students who have already been selected based on Academic Profile Code 
and undergraduate and professional performance. They believe, however, “that this does 
not pose a serious problem.” (Ref. 12] 

Not mentioned in either case is the lack of some sort of control group. As the 


examinees in this study are all a specially selected group, there 1s no way to compare 
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them to the "universe" containing a// students. The selection process does not know 
whether Graduate Record Examination scores of those selected for the school are sig- 
nificantly higher than the scores of those not selected for graduate education. 

The author conducted an informal ad hoc survev of a number of classmates to de- 
termine whether they knew why they were taking the exam and what sort of effort they 
made in taking the test. Most of the classmates admitted a vague understanding of why 
they were taking the Graduate Record Examination. Many, however, indicated that 
they had not exerted as much effort as they would have had the exam been a require- 
ment for admission. None of the students had made an effort to studv or otherwise 


prepare for the exam. 


B. OLDER STUDENTS 

Students selected for the Naval Postgraduate School are generally lieutenants or 
lieutenant commanders. This means they have been in the Navy at least four vears and 
are generally in their mid- to late twenties. As revealed earlier, the test-takers in the 
current study average 3i vears of age and had earned their undergraduate degree an av- 
erage of 7.6 years ago. 

Several researchers have studied the effect on Graduate Record Examination scores 
of being an “older student.” Hartle, Baratz and Clark looked at test-takers who were 30 
years of age or older or who had graduated with an undergraduate degree eight or more 
years ago. Thev found that the sample had a greater number of women and minorities 
than expected. Their hypothesis was that these categories of people, for a number of 
reasons, do not go directly to graduate school from their undergraduate programs. They 
also found that choice of studies favored education and the humanities and social sci- 
ences. Their bottom line was that, on average, older students’ Graduate Record Exam- 
ination scores were lower than vounger students’ scores--particularly in the quantitative 
portion of the exam. [Ref. 21] 

Clark discussed the subject further in 1984 and found that average verbal scores 
were about the same for both tvpes of students. Quantitative scores, however, were 
generally lower. She further reported on a study conducted by Hartnett and Oltman in 
1983. They reported that overall, the verbal scores tend to be higher for “older” women 
and about the same for "older" men. The quantitative scores are usually lower for both 
mentand women. [Ref. 22] 

It remains for a further study to determine whether the scores--especially quantita- 


tive scores--should perhaps be weighted in some fashion to account for the “older” 


students or whether the Graduate Record Examination should simply be administered 


at an earlier time in an officer’s career. 


C. PREPARATORY STUDY 

Swinton and Powers have studied the effects of coaching and preparatory study on 
the Graduate Record Examination for about six years. Their latest effort in 1985 con- 
cluded that any coaching or preparatory study beyond average student preparation for 
the Graduate Record Examination would “probably not result in higher test scores.” 
[Ref. 23: p. 23] This conclusion applied to all three measures of the Graduate Record 
Examination. Thev assume sorte test preparation (i.e., reading the GRE Information 
Bulletin) by the average student. Not only have Naval Postgraduate School test-takers 
not received the Bulletin prior to the exam, they have no real incentive to undertake even 


limited preparation. 
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VII. CONCLUSION 


A. SUMMARY 

The data reveal that the Graduate Record Examination is a much stronger predictor 
of graduate success than the Academic Profile Code. Even stronger is the Graduate 
Record Examination plus APCI and AGE. Although R? is not exceedingly large, this 
can be explained by the variety of other variables which can also be considered when 
making graduate selections. These are variables which would be very difficult to quan- 
tify: professional performance, promotability, military career path, variances among 
undergraduate institution grading policies, personality factors, family status and IQ are 


but a few. 


B. RECOMMENDATIONS 

Based on the analysis conducted in this thesis, Navy should consider using the 
Graduate Record Examination in conjunction with undergraduate grade point averages 
and the age of the officer. These measures should supplement professional and military 
considerations in the selection process. Rather than trying to establish a cutoff score for 
the Graduate Record Examination elements, selection boards should use Equation (5.2) 


to determine potential academic success at the Naval Postgraduate School. 


OPR* = 3.2185 — .0137AG E(in years) 4- .0006VB 
— OSISAPC] + .00070T + .0001A.N 


Where OER the predicted Graduate QPR 
AGE = the officer's age 


VB = the Graduate Record Examunation Verbal measure 
APCI- the Undergraduate QPR 

QT = the Graduate Record Examination Quantitative measure 
AN = the Graduate Record Examination Analytical measure 


This equation 1s recommended to simplify computations for the selection boards. 
The overall equation will allow boards to compute one equation for all candidates, re- 
gardless of choice of curriculum. The department factor should be applied later, during 


the assignment process, to better place students in appropriate curricula. 
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C. FURTHER RESEARCH 

Further research on this data should be conducted when the study is officially com- 
pleted. This will increase the number of cases for observation and undoubtedly enrich 
the results. 

A cost-benefit analysis should be conducted to determine which of the measures 1s 
more economical. This should include the current Academic Profile Code procedures, 
administration of the Graduate Record Examination (or reimbursement for exams ad- 
ministered at non-Navy facilities) and record maintenance costs. 

The effect of the time and place of administering the exam is an important issue 
which must be addressed. The exam should be administered early in an officer’s career 
in order to be available and current during the graduate education selection process. 

Further research needs to be made within the 15 departments. There 1s some evi- 
dence, even with this small data set, that predictions will vary across curricula. When a 
more reliable set of equations can be formulated, they should be used to select students 
and to place them into appropriate curricula. 

If the Graduate Record Examination is administered close to the officer's commis- 
sioning. there is still a potential problem of “older” students. Officer Candidate School 
and Officer Indoctrination Schoo] students can be older at commissioning than Reserve 
Officer Training Corps (ROTC) or Academy graduates. To make scores more equiv- 
alent, a weighting factor could be developed for the older examinees. 

In any case, the Graduate Record Examination should be a much better predictor than 


the Academic Profile Code alone. 
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APPENDIX A. NPS CURRICULA 


OS Policy and Information Sciences Division 

52 Computer Science Department 
367 Computer Systems Management 
368 Computer Science 

53 Mathematcs Department 
380 Advanced Science 

54 Administrative Sciences Department 
813 Transportation Logistics Management 
814 Transportation Management 
815 Acquisition and Contract Management 
819 Svstems Inventory Management 
527 Matenal Logistics Support Management 
$37 Financial Management 
547 Manpower, Personnel and Training Analysis 
620 Telecommunications Systems Management 

55 Operations Research Department 
360 Operations Analvsis 
361 Operational Logistics 

56 National Security Affairs Department 
681 Middle East, Africa, South Asia 
682 Far East, Southeast Asia, Pacific 
CSO UTOPS CSSR 
684 International Organizations and Negotiations 
685 Western Hemisphere 
686 Strategic Planning - General 
687 Strategic Planning - Nuclear 
825 Intelligence 

06 Sciences and Engineering Division 

6] Phvsics Department 

530 Weapons Systems Engineering 


331 Weapons Systems Science (Physics) 


B 


62 


67 


68 


69 


2 


~ 
G2 


74 


532 Nuclear Physics (Weapons and Effects) 

535 Underwater Acoustics 
Electrical and Computer Engineering Department 

590 Electronic Svstems Engineering 

600 Communications Engineering 
Meteorology Department 

372 Meteorologv 

373 Air-Ocean Science 
Aeronautics Department 

610 Aeronautical Engineering 

611 Aeronautical Engineering - Avionics 
Oceanography Department 

374 Operational Oceanography 

440 Oceanography 

441 Hydrographic Sciences 
Mechanical Engineering Department 

570 Naval (Mechanical) Engineering 
Antisubmarine Warfare Academic Group 

525 Antsubmarine Warfare Systems 
Electronic Warfare Academic Group 

595 Electronic Warfare Systems Engineering 
Space Systems Academic Group 

366 Space Systems Operations 

591 Space Systems Engineering 
Command, Control and Communications Academic Group 


365 Joint Command, Control and Communications 
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APPENDIX B. DEPARTMENT STATISTICS 


pNComputer Science (N= 29) 


Table 21. DESCRIPTIVE STATISTICS--DEPARTMENT 52 


Standard 


Maximum Deviation 


Minimum 


Variable Mean 


AGE 
T 
APCI 
APC2 
APC3 
VB 
QT 
AN 


31.43 
8.11 
2-12 
2.54 
8.03 

536.43 
596.07 
S5 9» 


26 


3:05 
Coy 
950 
290 
1.88 
75.44 
90.81 
78.47 


3.43 





Table 22. REGRESSION RESULTS--DEPARTMENT 32 


Variables 


APCI, VB, QT, AN, AGE 


Forecast Interval: 3.479 4 1.96(.2254); that 1s, 3.04 —— 3.92 


OPR* = 3.2185 — .01374GElin years) + .0006 VB 
— OSISAPCI + .00070T + .0001 AN 
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Table 23. 
AGE T 
AGE 1.000  .788 
(28) (27) 
„000 
il 1.000 
(27) 
VB 
QT 
AN 
APCI 
APC? 
ADC 3 
ZQPR 


VB 


.400 
(28) 
017 


34] 
(27) 
055 


1.000 
(28) 


Correlation Coefficient 
(Number of Cases) 
One-Tailed Significance Level, p-value 


QT 


-.236 
(25) 
.113 


-.106 
(27) 
.299 


25 
(25) 
064 


1.000 
(23) 


AN 


-.167 
(28) 
198 


-.195 
(27) 
.164 


303 
(28) 
058 


697 
(25) 
.000 


1.000 
(25) 


CORRELATION TABLE--DEPARTMENT 52 


AP 


125 
(26) 
27) 


073 
(25) 
364 


-.160 
(26) 
217 


-.417 
(26) 
O17 


-.132 
(26) 
.26] 


1.000 
(26) 


¡POR 


328 
(20) 
054 


.339 
(25) 
049 


-.019 
(26) 
463 


-.482 
(26) 
.006 


255 
(26) 
104 


611 
(26) 
.000 


1.000 
(26) 


APCS 


343 
(26) 
043 


308 
(25) 
.067 


05] 
(26) 
403 


-.689 
(26) 
.000 


-.279 
(26) 
084 


472 
(26) 
008 


601 
(26) 
001 
1.000 
(26) 


ZQPR 


-.260 
(25) 
.091 


-.061 
(27) 
382 


088 
(28) 
328 


481 
(25) 
005 


134 
(28) 
249 


-453 
(26) 
.010 


-.562 
(26) 
00] 
-.403 


(26) 
.02] 


1.000 
(25) 


53 Mathematics (N70) 


No statistics computed. 


54 Administrative Sciences (N= 66) 


Table 24. DESCRIPTIVE STATISTICS--DEPARTMENT 54 


Standard 
Variable Mean Minimum Maximum Deviation 


AGE 
ET 

APCI 
APC2 
APC3 


Sess 
8.06 
1.83 
3.00 


4.27 * 


5:50.15 
287.98 
373.9] 


37 
15 


3.16 
3.00 
33 
1.165 
li 
92.89 
sol 
96.36 


O : S 2230 





Table 25. REGRESSION RESULTS--DEPARTMENT 54 


Variables 


AECI VB, OT, AN, AGE 


Forecast Interval: 3.479 + 1.96(.2007), that is, 3.09 —— 3.87 


OPR* = 2.8066 + .0010A GE(in\years) — .0070A4 PC] 
T .0003V B + .00070T + .00014N 
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Table 26. 


AGE T 
AGE 1.000  .703 
(66) (65) 
,000 
T 1.000 
(65) 
VB 
QT 
AN 
APC] 
APC2 
APC3 
ZOPR 


VB 


-.116 
(66) 
Bum 


Eun) 
(65) 
2192 


1.000 
(66) 


Correlation Coefficient 
(Number of Cases) 
One-Tailed Significance Level, p-value 


QT 


-.261 
(66) 
017 


-.067 
(65) 
298 


447 
(66) 
000 


1.000 
(66) 


AN 


-.291 
(66) 
.009 


-.099 
(65) 
ae 


‚536 
(66) 
000 


.662 
(66) 
000 


1.000 
(66) 


CORRELATION TABLE--DEPARTMENT 54 


APC] 


010 
(64) 
467 


-.087 
(63) 
.248 


-.226 
(64) 
037 


-.214 
(63) 
044 


-.039 
(64) 
380 


1.000 
(64) 


ADC 7 


.336 
(64) 
.003 


.198 
(63) 
060 


-.082 
(64) 


229 


-.246 
(03) 
u 


-.216 
(64) 
O44 


-.016 
(64) 
.450 


1.000 
(64) 


Aue 


IS 
(64) 
.044 


057 
(63) 
328 


-.244 
(63) 
.026 


-.334 
(63) 
.003 


-.278 
(64) 
O13 


-.168 
(63) 
092 


392 
(64) 
001 


1.000 
(64) 


SS 


56 


6] 


62 


63 


67 


68 


69 


TI 


[2 


13 


74 


Operations Research (N= 13) 


No statistics computed. 


National Security Affairs (N= 18) 


t o statistics computed. 


Physics (N= 12) 


No statistics computed. 


Electrical and Computer Engineering (N= 16) 


No statistics computed. 


Meteorology (N=4) 


No statistics computed. 


Aeronautics (N= 5) 


No statistics computed. 


Oceanography 


No Statistics computed. 


Mechanical Engineering (N= 13) 


No statistics computed. 


Antisubmarine Warfare (N^ $) 


No statistics computed. 


Electronic Warfare (N= 2) 


No statistics computed. 


Space Systems (N= 12) 


No statistics computed. 


Command, Control and Communications (N= 1) 


No Statistics computed 
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